'  flD-fl 149  015  INEQUALITIES  FOR  THE  H/G/INFINITY  QUEUE  AND  RELATED 
SHOT  NOISE  PROCESSESCU)  STANFORD  UNIV  CA  DEPT  OF 
STATISTICS  F  HUFFER  29  NOV  84  TR-351  N00014-76-C-0475 
UNCLASSIFIED  F/G  12/1 


1 

& 

END 

Cr»*-  • 


.V;  ‘  -  ■  •**>'*'  ■. 


INEQUALITIES  FOR  THE  M/G/»  QUEUE 
AND  RELATED  SHOT  NOISE  PROCESSES 

BY 

FRED  HUFFER 

TECHNICAL  REPORT  NO.  351 
NOVEMBER  29,  1984 


Prepared  Under  Contract 
N00014-76-C-0475  (NR-042-267) 

For  the  Office  of  Naval  Research 

Herbert  Solomon,  Project  Director 

Reproduction  in  Whole  or  in  Part  is  Permitted 
for  any  purpose  of  the  United  States  Government 

Approved  for  public  release;  distribution  unlimited. 


DEPARTMENT  OF  STATISTICS 
STANFORD  UNIVERSITY 
STANFORD,  CALIFORNIA 


>  =  i..EC‘i  ... F 

JAN  7  1985 


Inequalities  for  the  M/G/“  Queue  and  Related  Shot  Noise  Processes 

By 

Fred  Huffer 

Florida  State  University 

1.  Introduction  and  Main  Results. 

This  report  deals  with  shot  noise  processes  X(t)  which  are  formed 
by  the  superposition  of  pulses  having  random  durations.  The  parameter  t 
will  be  either  a  point  on  the  line  or  on  the  circle  which  are  denoted  by 
L  and  C  respectively.  The  simplest  such  process  is  the  M/G/°°  queue 
which  is  formally  defined  by 

00 

x '  t.L  vw 

where  {T^ : — 00  <  i <  00 }  are  the  ordered  arrival  times  of  a  Poisson  process 

having  rate  X,  {Z^ :  — <*>  <  i  <  <*>}  are  nonnegative  random  variables  with  finite 

expectation  which  are  independent  and  identically  distributed  according  to 

the  distribution  F,  and  I,  .  ,  denotes  the  indicator  function  of  the 

la.bj 

closed  interval  [a,b].  Thus  X(t)  is  the  number  of  busy  servers  at  time 
t  in  an  M/G/<*>  system  where  customers  arrive  at  rate  X  and  service  times 
have  the  distribution  F.  X  is  a  stationary  process  with  EX(t)  ■  X(EZq) 
for  all  t.  We  use  the  notation  X  ^  L(X, F)  to  refer  to  the  process  X 
determined  by  X  and  F. 

We  now  define  an  analogous  process  X  on  a  circle  having  circumference 
P.  Let  {Z^:l  £  i  £  n}  be  independent  random  variables  satisfying 
0  <Zt  <  P  for  all  i.  Fj^  will  denote  the  distribution  of  Z^.  Place 
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n  arcs  with  lengths  Z^,Z^,...,Z^  uniformly  and  independently  on  the 
circle.  For  any  point  t  on  the  circle,  let  X(t)  be  the  number  of 
these  arcs  which  cover  t.  It  is  more  convenient  notationally  to  think 
of  X  as  a  periodic  step  function  (with  period  P)  defined  by 


^  “  I  ^fT  T  +7  1 

i-1  1  i*  i iJ 


where  {T^rl  <_  i  _<  n}  are  independent  random  variables  distributed  uni¬ 
formly  on  the  interval  [0,P)  and  is  a  periodic  indicator  function 

defined  when  0  <  b-a  <  P  by 


[a,b] 


[a+kP,b+kP]  ’ 


We  use  the  notation  X  ^  CpCF^^, . . .  ,Fn)  to  refer  to  the  process  X  on 

the  circle  (or  the  equivalent  periodic  process  on  the  line)  which  is 

determined  by  the  distributions  F^,F2» . . . .F^. 

We  shall  present  results  which  indicate  how  the  processes  L(A,F)  and 

C„(F, ,F», . . . ,F  )  change  as  the  distributions  F  or  F.  are  altered  to 
r  i  i  n  1 

increase  their  variability.  The  precise  notion  of  "increasing  variability" 
we  shall  use  is  contained  in  the  following  definition. 

Definition:  Suppose  Y  and  Z  are  random  variables  with  e|y|  <  00 
and  E | Z |  <  00  having  distributions  F  and  G  respectively.  If 
E4>(Y)  <_  E$(Z)  for  all  convex  functions  <£:  R  -►R,  then  we  say  that 
F  -J  G  or  equivalently  Y-}  Z. 

Note  that  Y  -i  Z  implies  EY  ■  EZ  and  Var  Y  Var  Z. 
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The  variability  ordering  is  well  known  and  has  been  extensively 
used  to  derive  inequalities  in  queueing  theory.  See  Whitt  [14]  for  an 
example  of  this  use  and  Stoyan  [11,12]  for  a  survey  of  some  of  the  litera¬ 
ture.  Rolski  [6]  and  Stoyan  [12]  are  good  sources  on  partial  orderings  of 
probability  distributions.  Ross  [7]  gives  an  elementary  treatment  of 
variability  orderings. 

Our  results  concern  random  variables  which  may  be  written  as  func¬ 
tionals  H(X)  of  the  process  X.  We  assume  that  H(f)  is  defined  for 
all  f  in  some  class  of  functions  F.  The  relevant  classes  of  functions 
are  now  given.  Let  6  be  the  set  of  upper  semicontinuous  step  functions 
which  take  on  only  nonnegative  integer  values,  have  no  jumps  of  magnitude 
greater  than  one,  and  have  only  finitely  many  jumps  in  any  bounded  interval. 

Clearly  P{X  e  G}  ■  1  for  any  of  the  processes  X  ^  L(X,F).  Let  G  be 

n,r 

the  set  of  periodic  step  functions  (with  period  P)  which  can  be  written 
in  the  form 


n 

Ji  J[vbi1 


for  some  values  of  a^  and  b^. 

The  principal  conditions  we  shall  impose  on  the  functionals  are  the 
following . 

Definitions: 

If  H(f v  g)  +  H(f Ag)  >  H(f)  +  H(g)  whenever  f ,g,f v  g,f  a  g  all  belong 
to  F,  we  say  that  H  is  L-superadditive .  If  both  H  and  -H  are 


L-superadditive,  we  say  that  H  is  L-additive. 


A  function  h  with  k  arguments  is  said  to  be  L-superadditive  if 
h(xv  y)  +  h(xAy)  h(x)  +  h(y)  for  all  x  and  y  in  This  condi¬ 

tion  was  introduced  by  Lorentz  [2],  L-superadditive  functions  have 
been  used  to  obtain  inequalities  in  a  variety  of  settings.  See  Marshall 
and  Olkin  [3]  for  a  survey  of  some  of  these  uses. 

Here  are  some  other  conditions  we  shall  use.  All  functions  below  belong 
to  the  relevant  domain  F.  H  is  bounded  if  there  exists  a  constant  b  such 
that  | H(f ) |  <  b  for  all  if.  H  is  increasing  if  H(f)  £  H(g)  whenever 
f  £  g.  H  is  local  if  there  exists  a  bounded  interval  [c,d]  such  that 
H(f )  =*  H(g)  whenever  f(t)  *  g(t)  for  all  t  in  [c,d]. 

We  now  state  some  special  cases  of  our  main  results.  Consider  the 
following  situations. 

(1.1)  Let  X  a.  L(X,F)  and  X*  *  L(X*,F*)  with  X  -  X*  and  F-$F*. 
Suppose  H  is  a  local  functional  defined  for  all  f  in  6.  Assume  that 

H  is  bounded,  or  alternatively,  assume  that  H  is  increasing  with  both 
E | H(X) |  <  ®  and  e|h(X*)|  <  «. 

(1.2)  Let  X  -v  Cp(F1,F2,...,Fn)  and  X*  Cp(F*,F*, . . .  ,F*)  with 

i k  - 

F. H  F.  for  all  i.  Assume  that  H  is  bounded  on  G  „. 
i  l 

(1.3)  Theorem:  The  statements  (a)  and  (b)  given  below  hold  true  for 
both  situations  (1.1)  and  (1.2); 

(a)  If  H  is  L-superadditive,  then  EH(X)  £  EH(X*)  . 

(b)  If  H  is  increasing  and  L-additive,  then  H(X)  H(X  ). 


2. 


Examples. 

Let  X  and  X  be  as  in  (1.1).  To  obtain  consequences  of  Theorem 
(1.3)  we  need  to  exhibit  local  functionals  H  which  are  L- super additive 
or  increasing  and  L-additive. 

(2.1)  Example:  Suppose  h  is  a  k-dimensional  L-superadditive 

lc 

function,  h(xvy)  +  h(xAy)  £  h(x)  +  h(y)  for  all  x,y  eS  .  When  h 
has  continuous  partial  derivatives  3^h(x)/3x^3Xj ,  the  condition  of 
L-superadditivity  is  equivalent  to  the  requirement  that  3^h(x)/3xi3x^  _>  0 
for  all  x  and  all  i  ?  j.  Let  be  fixed  times.  Define 

the  functional  H  by  H(f)  *  h(f  (t^)  ,f  (tj)  , . . .  ,f  (t^)  ) .  H  is  easily  seen 
to  be  local  and  L-superadditive.  If  h(x^,X2» . . . ,xfc)  is  bounded  (or 
increasing)  when  x^  £  0  for  all  i,  then  H  will  be  bounded  (or 
increasing)  and  thus  EH(X)  £  EH(X  ).  A  simple  special  case  is  h(x,y) ■  xy 
which  gives  EX(s)X(t)  £  EX*(s)X*(t)  for  all  s  and  t.  Since 

it  it 

EX(s)  *  EX  (t)  for  all  s  and  t,  this  says  that  X  is  "more  correlated" 
than  X. 

(2.2)  Example:  Let  A  be  a  bounded  set  and  T  be  any  function  satisfying 
t(t)  *  0  when  t  t  A.  Define 


H(f  ) 


1  if  f(t)>4'(t)  for  all  t, 

< 

0  otherwise  . 


H  is  clearly  bounded  and  local  and  it  is  L-superadditive  because 

H(f  a  g)  ■  H(f) a  H(g),  H(fvg)  >  H(f)v  H(g)  and  H(f)  a H(g)  +  H(f) v  H(g)  - 

H(f )  +  H(g).  Therefore  EH(X)  -  Prob(X>'il)  £Prob{X*£f}  -  EH(X*). 
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Suppose  now  that  Y  satisfies  ¥(t)  *  00  for  t  t  A  and  define 


1  if  f(t)<nt)  for  all  t. 


0  otherwise 


Again,  H  is  bounded,  local  and  L-superadditive  so  that  (1.3a)  yields 
Prob{X  £  ¥}  <  ProbtX*  £  'i'} . 

By  considering  functions  ¥  of  the  form 


¥(t)  = 


c  for  t  e  A 


d  for  t  t  A 


where  d  *  0  or  00  and  applying  the  above  facts  we  obtain  the  stochastic 
orderings 

•ff 

sup(X(t) : teA}  £  sup{X  (t):teA},  and 

—  S  L 

inf(X(t):teA>  <  „  inf{X*(t):teA>. 

—  st 


Here  £  means  "stochastically  greater  than", 

St 


(2.3)  Example:  Let  it  be  any  measure  on  the  strip  [a,b]  x  [ 0 ,°°) , 

Use  (t,x)  to  denote  a  point  in  [a,b]  x  [0,®).  For  any  measurable 

function  f  define  the  set  »  ((t,x):f(t)  £x).  Now  define  H  by 

H(f)  ■  Tr(D,).  Since  D.  ,  «  D,uD  and  D,  .  »  D.nD  we  have 

f  fvg  f  g  f  A  g  f  g 

H(f  V  g)  +  H(f  A  g)  -  TT(Df  u  Dg)  +  TT(Df  n  Dg)  -  ir(Df )  +  Tr(Dg)  -  H(f )  +  H(g) . 
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Thus  H  is  increasing,  local  and  L-additive.  If  it  is  chosen  so  that 
EH(X)  <  «  and  EH(X*)  <  »,  then  (1.3b)  gives  H(X) -J  H(X*). 

As  special  cases  of  this  class  of  increasing  L-additive  functionals 
we  give  the  following.  In  each  case  it  is  easy  to  describe  the  measure  tr 
which  yields  the  functional  H. 


(a)  Choose  any  values  and  y^.y^,. 


. ,yk  and  define 


H  by 


H(f>  ’  k  ^  >-  V 


(b)  Choose  T  >  0  and  let  ¥  be  any  measurable  function.  A  continu¬ 


ous  version  of  (a)  is 


fT 

H(f)  =  JQ  1{f (t)  >  ¥(t)}dt  * 


(c)  We  may  similarly  define 


H(f )  -  (f(t)-f(t)),dt 

J0 


where  (Z)+  denotes  the  positive  part,  (Z)+  =  max(Z,0), 


(2.4)  Example:  We  now  present  a  functional  H  which  is  not  increasing 

* 

but  still  yields  H(X) -J  H(X  ).  This  functional  does  satisfy  a  weaker  condi¬ 
tion  given  in  section  (4).  We  shall  describe  the  functional  H  in  terms  of 
the  M/G/oo  queue.  Choose  an  integer  k  and  a  duration  L.  Let  H(X)  be 
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i 


the  number  of  customers  who  arrive  during  the  interval  [0,L]  and  find  at 
least  k  customers  already  being  served.  Using  the  notation  in  section 
(1)  we  may  write 


H(X) 


il  I{0<Ti<L,X(T.)>k+l}  * 


This  functional  depends  explicitly  on  the  values  of  the  arrival  times 
and  cannot  comfortably  be  regarded  as  a  functional  of  just  the  sample  path 
X.  Alternatively,  we  can  take  H(X)  to  be  the  number  of  customers  who 
arrive  during  [0,L]  and  find  at  most  k  customers  already  being  served. 
This  definition  also  yields  H(X)  -i  H(X*). 

(2.5)  Example:  Now  take  X  and  X*  to  be  the  periodic  processes  of 
(1.2).  All  of  the  previous  examples  may  be  restated  in  terms  of  these 
periodic  processes.  We  then  obtain  various  inequalities  concerning  coverage 
problems  on  the  circle.  For  example,  let  H^X)  be  the  indicator  of  the 
event  that  every  point  on  the  circumference  is  covered  at  least  k  times, 

k 

example  (2.2))  so  that  EH^(X) 

which  implies  the  truth  of  a  conjecture  made  by  Siegel  [8]  concerning 

coverage  probabilities.  (In  our  notation  Siegel's  conjecture  was  that 

EH. (X)  <  EH. (X*)  when  F.  =  F,  *  ...  -  F  and  F*  =  F*  =  •  •  •  =  F*  with  F. 
x  —  l  x  z  n  l  z  n  l 

*  * 
and  F^  obeying  a  condition  somewhat  stronger  than  F^  -A  F^.) 

Siegel  [8,9]  also  considered  the  distribution  of  the  total  length  of 
the  uncovered  portion  of  the  circumference.  A  more  general  quantity  is  the 
total  length  of  that  part  of  the  circumference  covered  at  most  k  times, 
denoted  by  V^.  More  formally. 


£  EH^tX  ).  Taking  k  *  1  yields  an  inequality 


for  all  t}*  ^k  bounded  and  L-superadditive  (as  in 


V»  *  ‘{xu)  > 


s 


V^(X)  *  /q  ^{x(t)<k}dt*  As  in  examPle  (2.3b),  it  is  easily  shown  that 
-V^  is  bounded,  increasing  and  L-additive  and  thus  V^(X) -4  V^(X  )• 


Siegel  and  Holst  [10]  give  results  concerning  the  distribution  of 
the  number  of  uncovered  gaps  on  the  circumference  which  we  shall  denote  by 
G.  Using  the  notation  of  section  1  we  may  write 


G(X) 


n 

I{X(Ti)=l}  * 


As  in  example  (2.4),  the  functional  -G  does  not  quite  satisfy  the  condi¬ 
tions  in  (1.3b)  but  does  satisfy  the  weaker  conditions  given  in  section  4 
so  that  G(X)  -i  G  (X* ) . 

The  results  in  this  example  concerning  the  functionals  R.  and  V 


were  first  given  by  the  present  author  in  [1].  The  methods  and  results 
of  [1]  are  similar  to  but  less  general  than  those  of  this  paper. 


3. 


Corollaries . 


Theorem  (1.3)  sometimes  allows  us  to  compare  the  processes  X  and  X* 
when  the  arrival  rates  differ,  X  ^  A*.  Using  this  we  can  prove  a  result 
concerning  the  behavior  of  X  when  the  time  axis  is  rescaled. 

Notation:  Let  5  denote  the  distribution  which  places  all  of  its 
mass  at  y,  5^(x)  =  0  for  x  <  y  and  5^(x)  =  1  for  x  ^  y. 

^  ^ 

(3.1)  Corollary:  Suppose  that  X  'u  L(A, F)  and  X  'V  L(A  ,F  )  and 
there  exists  a  constant  0  such  that  0  <  8  <_  1,  X*  *  0A  and 
F (1-8)6q+6F  .  Let  A  be  the  countable  set  of  arrival  times  of  a 
Poisson  process  with  arbitrary  rate  a.  Let  H  be  a  functional  satisfying 
the  conditions  in  (1.1)  and  assume  also  that  for  any  f  e  G,  H(f)  =  H(f+IA) 
almost  surely.  Under  these  conditions  (1.3a)  and  (1.3b)  hold  true. 

In  this  corollary,  X  is  composed  of  pulses  which  tend  to  be  longer 
than  the  pulses  in  X  but  which  arrive  at  a  slower  rate.  These  differences 
are  balanced  so  that  we  still  have  EX(t)  =  EX  (t). 

Proof  of  (3.1):  Let  X#  *  L(A#,F#)  with  A#  =  X  and  F#  =  (1-B)60+BF*. 
Since  F  H  F^,  Theorem  (1.3)  applies  directly  to  X  and  X^.  Now  note  that 

ft  #  * 

H(X  )  and  H(X  )  have  the  same  distribution  because  X  may  be  obtained 

from  X^  by  eliminating  those  pulses  in  X^  which  have  zero  duration. 

if  * 

More  precisely,  X  has  the  same  distribution  as  X  +  I  where  A  is  the 

set  of  arrival  times  of  an  independent  Poisson  process  with  rate  of  arrivals 

*  // 

equal  to  (1-8) A.  By  our  assumption  on  H  we  know  that  H(X  )  and  H(X  ) 

have  the  same  distribution  and  this  completes  the  proof. 

The  simplest  application  of  (3.1)  is  to  the  case  where  F  =  6g  and 

F  *  5  .  The  verification  that  50  -i  (1-8)60+66  when  0  <  B  <  1  is 
y  By  0  y  - 
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immediate.  This  example  may  be  generalized.  Let  Fog  denote  the  distri¬ 
bution  defined  by  (F  o  3)  (x)  =  F(Bx).  We  now  show  that  F  -j  (1-3) 6^+8 (F  o  8) 
when  0  <  8  £  1.  Let  R  be  a  random  variable  taking  on  the  values  0 
and  1  with  probabilities  1-8  and  8  respectively.  Let  V  have  the 
distribution  F  and  be  independent  of  R.  Define  W  =  RV/B.  The  distri¬ 
bution  of  W  is  (1-8)8q+6(F o  8) .  Since  E(w|v)  *  V,  Jensen's  inequality 
for  conditional  expectations  gives  E4>(V)  £  E4>(W)  for  all  convex  functions 
<t>  and  thus  V  -i  W  as  desired.  This  justifies  the  application  of  (3.1) 
when  X  'V-  L(A,F)  and  X  ^  L( A  ,F  )  with  A  =  BA,  F*(x)  =  F(Bx)  for  all 
x  and  0  <  8  £  1. 

(3.2)  Corollary:  Let  X  ^  L(A,F)  and  H  be  a  bounded  and  local 
functional  which  also  obeys  the  condition  in  (3.1).  For  8  £  0  define 
XoB  by  (X  o  8)  (t)  *  X(8t)  for  all  t. 

(a)  If  H  is  L-superadditive,  then  EH(XoB)  is  a  decreasing  function 
of  8  for  3  £  0. 

(b)  If  H  is  increasing  and  L-additive,  then  H(Xo8)-5  H(Xoy)  when¬ 
ever  8  £  y£0. 

Proof  of  (3.2):  Assume  first  that  6  #  0.  To  verify  (3.2a)  it  suffices 
to  show  that  EH(Xo8)  £  EH(X)  when  8  £  1.  Similarly,  to  verify  (3.2b)  it 
suffices  to  show  that  H(X)  -J  H(Xo  8)  for  6  £  1.  But  these  follow  from 
(3.1)  and  the  previous  discussion  because  Xo8  ^  L(8A,  F  o  6)  .  The  case 
8=0  is  handled  by  taking  limits.  Since  H  is  local  and  X(t)  is 
constant  in  some  neighborhood  of  t  =  0  almost  surely,  H(XoB)  H(XoO) 
almost  surely  as  8  +  0.  Thus,  for  example,  E$(H(Xo8))  t  E4>(H(Xo0))  for 
any  convex  <J>  as  8  +  0. 


The  condition  in  (3.2)  that  H  be  bounded  is  just  a  convenient  way 
to  ensure  that  all  expectations  are  finite.  This  assumption  can  easily  be 
weakened . 

For  an  application  of  (3.2a)  we  go  back  to  example  (2.1).  Choose  any 
constants  a^a^...,^  and  define 

{1  if  xi  ai  for  ali  i» 

0  otherwise  . 

h  is  an  L-superadditive  function  on  *k.  By  (3.2a),  Eh(X(Bt1) ,X(6t2) , . . . , 
^(6t^))  =  Prob(X(8t^)  ai  for  all  i)  is  decreasing  in  8  for  any  values 
of  t^>  t^, . . . , t^ . 

For  an  application  of  (3.2b)  we  go  back  to  example  (2.3).  Choose  a 
constant  c  >  0  and  define 


Y  =  — 
8  6 


X{X(t)  >c}dt 


(3.2b)  implies  that  YQ-J  Y  when  8  >  Y- 

p  Y  ~ 


12 


s 

< 

1 

fl 


4.  Proofs  of  the  Main  Results. 

In  section  1  we  stated  a  theorem  concerning  processes  formed  by  the 
superposition  of  rectangular  pulses.  Now  we  shall  consider  pulses  of  a 
somewhat  more  general  shape;  the  pulses  will  increase  monotonically  to 
unit  amplitude,  remain  at  unit  amplitude  for  a  random  duration,  and 
then  decrease  monotonically  back  to  zero.  The  pulses  form  a  parametric 
family  of  functions  denoted  {gg:0  d)  where  the  parameter  0  indicates 
the  total  duration  of  a  pulse  and  d  is  the  duration  of  the  briefest 
pulse  in  the  family.  The  complete  definition  is  given  below. 

Choose  b  >  0  and  c  _>  0.  Let  5  be  any  increasing  function  on 
[0,b]  with  5(0)  0  and  5(b)  *  1.  Let  \p  be  any  decreasing  function 

on  [0,c]  with  iKO)  =  1  and  tp(c)  _>  0.  For  0  >1  b+c  define 


g0(t) 


5(t)  for  0  <t  <b  , 

1  for  b  £  t  £  0-c  , 

<Mt-0+c)  for  0-c  <_  t  £  0, 

0  otherwise  . 


In  this  parametric  family  the  minimum  duration  is  d  =  b+c. 

The  family  (gg:0  1  d}  has  two  properties  we  shall  need.  First  note 

that 

(4.1)  gg(t)  *  0  unless  0  £  t  £  0  . 

The  second  and  more  important  property  is 
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for  all  0>d,  £  >  0,  6  >  0 


Here  we  have  used  to  represent  a  shift  operator;  (S^f ) (t)  = f (t-e) 

for  all  functions  f  and  all  t. 

We  now  define  a  shot  noise  process  on  the  line  (L)  as  in  section  1. 
Let  <  i  <  00 }  be  the  ordered  arrival  times  of  a  Poisson  process 

having  rate  A.  Let  {Z^:-“  <  i  <  <»}  be  independent  with  the  distribution 
F  and  satisfy  Prob{Z^  ^  d}  *  1  and  EZ^  <  <*>.  Define  X^KA.F)  by 


X(t)  •l  g  (t-T  )  . 
i=-°°  i 


Next  we  define  the  analogous  periodic  process  with  period  P  which 
is  equivalent  to  a  process  on  a  circle  with  circumference  P.  For 
d  <_  9  <  P  define  the  periodic  pulse  gA  by 


gg(t)  -  l  gg(t-kP)  . 

k*-®° 


Let  Z^,Z2»...,Zn  be  independent  random  variables  with  distributions 
F^,F2»...,Fn  and  satisfying  Prob{d^  £  Z^  <  P}  *  1  for  all  i.  Let 
Tl’^2’‘“’’^n  independent  random  variables  distributed  uniformly  on 
the  interval  [0,P).  Define  X  ^  Cp  (F^^, . . .  ,Fn>  by 


X(t)  -  l  g^  (t-T  )  . 


We  shall  first  prove  a  theorem  concerning  CpCF^.Fj, . . . .F^) . 

From  this  we  obtain  a  corresponding  result  for  L(A,F).  The  results 

stated  in  section  1  will  follow  as  corollaries. 

Reusing  the  notation  of  section  1,  we  take  G  „  to  be  the 

n,F 

class  of  all  functions  f  which  can  be  written  in  the  form 


£  •  I  s  gj 

i-1  i  i 


for  some  values  of  t^  and  0^  with  d  <_  9^  <  P  for  1  £  i  <_  n. 

In  the  discussion  below,  H  will  always  be  a  functional  defined  on 

some  class  of  functions  which  includes  G  _. 

n*P 


Lemma:  If  H  is  L-superadditive,  then 


(4.3)  «£«es5+e+s>  +  "<f+We> 


>  H(f+Stg  0+e^  +  H(f+St+eg6+6) 


for  all  f  e  G  ,  _ ,  all  t  and  all  0>d,  e>0,  6>0  satisfying 
n-i, r  —  — 

0+e+6  <  P. 


Proof  of  Lemma:  Using  (4.1)  and  (4.2)  we  obtain 


®9+e+6  "  g9+e  V  (Seg0+6)  and 


S£g0  *  80+e  A  (Seg9+6) 


for  all  0>d,  e  >  0,  <5  >  0  satisfying  0+e+5  <  P. 


Applying  St  and  adding  f  to  both  sides  of  these  equations  leads  to 

f+sc8e+s+«  '  (f+st*e+e)  v  <f+st+E*w«> 

and 

f+st+e8e  ■  (f+st«e«>  A  <f+st+£8e+6)  • 

Now  L-superadditivity  yields  (4.3). 

(4.4)  Theorem: 

Let  X  ^  Cp(F1,F2,...,Fn)  and  X*  ^  Cp(F*,F* . F*)  with  F±  -4  F* 

for  all  i.  If  H  satisfies  (4.3)  and  H(f)  >  0  for  all  f  e  G  , 

—  n,r 

then  EH(X)  £  EH(X*). 

Proof  of  Theorem:  The  condition  H  ^  0  ensures  that  EH(X)  and 

EH(X*)  are  well  defined.  It  suffices  to  prove  (4.4)  in  the  special  case 

where  F.  »  F.  for  1  <  i  <  n-1  and  F  F  .  The  general  result  is 
i  i  —  —  n  n 

then  obtained  by  repeated  applications  of  this  special  case.  Assuming 

It  & 

F^  *  F^  for  1  £  i  £  n-1  allows  us  to  define  X  and  X  on  the  same 

probability  space  as  follows 

X  -  W+ST  and  X*  *  W+S^  g'* 

n  n  n  Z 

n 

where  W  *  ^T  ®Z  ’  Zi  ^  Fi  ^or  *  an<*  Zn  %  Fn‘ 
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Let  A  be  the  a-field  generated  by  T, ,Z_ ,T0,Z0, . . . ,T  ,  ,Z  . . 

1  i  i  l  n— l  n-1 

Conditional  on  A,  we  may  regard  W  as  a  fixed  (nonrandom)  function. 
The  next  lemma  shows  that  E(H(X)|A)  <_  E(H(X  )|A).  Taking  unconditional 
expectations  completes  the  proof.  (Note:  If  either  EH(X)  or  EH(X*) 
is  infinite,  the  same  basic  argument  works.  However,  instead  of  the 
convenient  notation  of  conditional  expectation,  we  must  now  write  the 
expectations  as  multiple  integrals  and  then  use  Fubini's  theorem.) 


(4.5)  Lemma:  Choose  any  f  e  G  ,  Suppose  that  H  >  0  on 

n— 1,F  — 

G  n  and  that  H  satisfies  (4.3).  For  d  <  0  <  P  define 
n,r  — 


$(0)  = 


H(f+Stg')dt 


Let  and  Y2  be  random  variables  taking  values  in  [d,P).  If 

YXS  Y2,  then  E<I>(Y1)  _<  E4> (Y£) . 

Proof  of  Lemma:  Integrating  with  respect  to  t  in  (4.3)  and 
using  the  periodicity  of  gg  yields 


$(0+e+6)  +  $(0)  >  <J>(0+e)  +  $(0+6) 


for  all  0  ^  d,  e^O,  6^0  satisfying  0+e+6  <  P.  This  says  that  $ 
is  convex  in  the  interval  [d,P).  If  $  can  be  extended  to  be  a  convex 
function  on  the  entire  real  line,  then  Y^  Y ^  implies  E$(Y^)  ^  E$(Y2) 

Even  when  $  cannot  be  so  extended,  we  still  have  E$(Y^)  ^  E$(Y2).  For 
this  argument  and  further  details  see  section  7. 


Theorem  (4.4)  implies  the  truth  of  (1.3a)  in  situation  (1.2).  To 
obtain  a  result  which  implies  (1.3b)  we  need  the  following  lemmas. 

Lemma:  If  H  is  increasing  and  L-additive,  then 

<4.M  'nw +  >«vi> 

-  H(f+Stg  0+€)  +  H(f+St+£gQ+(S), 

H(f+Stg^)  £  H(f+Stg  0+e)  ,  and 

for  all  f  e  G  .  all  t  and  all  0>d,  e>0,  6>0  satisfying 
n— i , r  —  — 

0+e+6  <  P. 

This  lemma  is  trivial  and  we  state  it  only  because  there  are  functionals 
which  satisfy  (4.6)  but  are  not  both  increasing  and  L-additive.  The 
functional  -G  of  (2.5)  is  such  a  functional. 

Proof  of  Lemma:  The  lemma  follows  from  noting  that  gg  £  gg)c, 

S£gg  £  8q+£  an<*  both  H  and  -H  satisfy  (4.3). 

(4.7)  Lenma:  Let  <p  be  any  convex  function.  <J>oH  will  denote  the 
composition  of  $  and  H;  ($OH)(f)  *  <fc(H(f)). 

(a)  If  H  is  increasing  and  L-additive,  then  is  L-superadditive. 

(b)  If  H  satisfies  (4.6),  then  $oH  satisfies  (4.3). 


Proof  of  Lemma:  To  prove  (a)  we  must  show  that  (4>oH)  (f  v  g)+ 
(<}>0H)(fAg)  _>  (<£oH)  (f  )+(<j>oH)  (g) .  Let  w=  H(f),  x  •  H(g),  y  *  H(f  t.  g) 
and  z  =  H(f  v  g).  By  the  assumptions  on  H  we  have  y  <_  w  a  x, 
z  ^  w  V  x  and  y+z  *  w+x.  Thus  by  convexity  4>(y)+<j>(z)  2.  <j>(w)+<j>(x) 
as  desired.  The  proof  of  (b)  is  similar. 

(4.8)  Corollary:  Let  X  and  X*  be  as  in  (4.4).  If  H  is 
bounded  on  G  and  satisfies  (4.6),  then  H(X)  HI  H(X  ). 

n,  r 


Proof  of  Corollary:  Let  <}>  be  any  convex  function.  <J>oH  is 

bounded  on  G  so  that  without  loss  of  generality  we  may  assume  that 
n,r 

(cJ>oH)  (f )  >_  0  for  all  f  e  G  p.  <J>oH  satisfies  (4.3)  by  the  preceding 

n,“ 

lemma.  Now  theorem  (4.4)  applies  to  yield  E<|»(H(X))  <_  E<}>(H(X  ))  thus 
completing  the  proof. 

To  obtain  results  for  L(X, F)  we  first  extend  (4.4)  and  (4.8)  to 
allow  for  a  random  number  of  pulses.  Let  M  be  a  Poisson  random  variable 
with  mean  XP.  Let  be  a  sequence  of  independent  random 

variables  uniformly  distributed  on  [0,P).  Let  . . .  be  i.i.d. 

according  to  F  and  satisfy  P{d  <  <  P}  ■  1.  The  random  variables 

M,  {T^}  and  {Z^}  are  jointly  independent.  Define 


M 

-  I  s 

i-1 


V*i 


To  refer  to  this  periodic  process  we  use  the  notation  X  'v  Cp(X,F). 


(4.9)  Corollary:  Let  X  ^  Cp(X,F)  and  X  ^  Cp(X*,F  )  with 

*  .  * 

X  -  X  and  F  H  F  . 


H  is  a  functional  defined  on  some  domain  which 


includes  U  _  G  where  Gn  „  consists  of  a  single  function  which 
n=0  n,P  0,P 

is  identically  zero. 

(a)  If  H  21  0  and  H  is  L-superadditive,  then  EH(X)  £  EH(X  ). 

(b)  If  H  is  bounded,  increasing  and  L-additive,  then 
H(X)  *4  H(X*) . 

Remark:  In  (a)  we  may  replace  L-superadditivity  by  a  condition  like 
(4.3).  In  (b)  we  may  replace  the  conditions  increasing  and  L-additive 
by  a  condition  like  (4.6).  The  details  are  omitted. 

Proof  of  Corollary:  Conditional  on  the  event  {M“n},  the  process 
Cp(X,F)  has  the  same  distribution  as  Cp (F^.F^, . . . .F^)  with  F^  *  F  for 
all  i.  Thus  we  may  condition  on  the  value  of  M  and  use  (4.4)  and  (4.8) 
to  obtain  (a)  and  (b)  respectively. 

Let  F  be  the  collection  of  all  functions  f  which  can  be  written 
in  the  form 

k 

f(t)  -  l  gQ  (t-T  ) 

i-1  i  1 

where  0  £  k  _<  "  and  9^  >  d  for  all  i.  When  k  *  0,  f  is  identi¬ 
cally  zero.  When  k  =  ",  we  must  also  require  that  f(t)  <  "  for  all 
t  and  that  no  bounded  set  contains  for  infinitely  many  values  of 

i.  For  X  'V  L (X , F),  it  is  clear  that  ProbCXcF}  =  1. 

We  now  state  the  basic  result  for  L (X , F ) . 

(4.10)  Theorem:  Let  X  'v  L(X,F)  and  X  'v  L(X  ,F  )  with  X  *  X 
and  F  F*.  Let  H  be  a  local  functional  with  domain  F.  Assume  that 


F  and  F  have  bounded  support,  F(B)  =  F  (B)  =  1  for  some  B  <  <*». 

Under  these  conditions  statements  (a)  and  (b)  of  (4.9)  are  true.  We 
also  have: 

(c)  If  H(f )  >  0  and  H(f+Stg0+£+6)  +  H(f+St+£gQ) 

>  H(f+StgQ+£)  +  H(f+St+£ge+6) 

for  all  f  e  F,  all  t  and  all  6  >  d,  e  _>  0,  6  _>  0,  then  EH(X)  <  EH(X*) 

(d)  If  H  is  bounded  and  H(f+Stg0+£+g)  +  H(f+St+£gQ) 

’  H<£+StW  +  B(f+st+eg8+«  *  • 

H(£+Stg0)  £  H(£+Stg0+e)  and 

a(£«t+£g9)  <  H<f«tge+(;) 

for  all  f  e  F,  all  t  and  all  9  ^  d,  £  >^  0  and  6  >_  0,  then  H(X)  H(X*) 

The  slightly  weaker  conditions  in  (c)  and  (d)  are  necessary  to  handle 
examples  like  (2.4). 

Proof  of  Theorem:  Since  H  is  local,  we  may  assume  without  loss  of 
generality  that  H(f)  depends  only  on  the  values  f(t)  for  t  belonging 
to  the  interval  [0,L].  Choose  a  value  of  P  such  that  P  >  L+B.  Let 
Y  *v>  Cp(X,F)  and  Y  ^  Cp(X  ,F  ).  The  periodic  pulse  Stg0  is  made  up 
of  translated  copies  of  g0  which  are  separated  by  intervals  of  length 
at  least  L  when  8  <  B.  Thus  at  most  one  of  these  copies  can  "intersect" 
the  interval  [0,L].  In  the  definition  of  Cp(X,F)  we  used  a  Poisson 
number  of  uniform  random  variables.  Equivalently,  we  could  have  used  the 
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arrival  times  of  a  Poisson  process  with  rate  X  on  the  interval  [0,P). 
These  remarks  make  it  clear  that  X  and  Y  can  be  defined  on  the  same 
probability  space  in  such  a  way  that  X(t)  *  Y(t)  for  0  £  t  <_  L.  To 
do  this  we  take 

00 

Y(t)  =  £  8Z.  (t"Ti)]:{-B  <  T  <  P-B} 

i=_co  i  —  i 

where  and  T  are  the  same  random  variables  used  in  defining  X. 

Thus  H(X)  and  H(Y)  have  the  same  distribution.  Now  the  result  follows 
by  applying  (4.9).  Statements  (c)  and  (d)  follow  from  the  remark  after 
(4.9).  The  details  are  omitted. 

Many  of  the  conditions  in  (4.10)  can  be  weakened.  First,  we  can 
eliminate  the  requirement  that  F  and  F*  have  bounded  support.  To 
do  this  we  need  the  following  lemma  which  will  be  proved  in  Section  7. 

We  shall  also  weaken  the  requirement  in  (4.9b)  that  H  be  bounded. 

Definitions:  Given  the  random  variables  V  and  {v  :1  <  n  <  °°> 

n  — 

we  say  that  =*>  V  if  Prob{Vn*V  for  all  sufficiently  large  n)  »  1. 

The  symbol  i  is  used  to  indicate  that  a  sequence  is  increasing. 

(4.11)  Lemma:  Let  V  and  W  be  nonnegative  random  variables  with 

EV  <  00  and  EW  <  co.  If  V-(  W,  there  exist  sequences  {V  }  and  {W  } 

n  n 

of  bounded  nonnegative  random  variables  satisfying  wn*>  ^n  *  v> 

W  «*>  W  and  V  S  W  for  all  n. 


Using  lemma  (4.11)  we  obtain  the  next  fact. 


(4.12)  Lemma:  Let  X  and  X  be  as  in  (4.10)  except  that  now 
* 

F  and  F  are  no  longer  required  to  have  bounded  support.  Let  H  be 
any  local  functional.  There  exist  sequences  of  processes  {X  }  and 
{X^}  with  the  properties  given  below. 


* 

n 


(a) 

X  a,  L(X,F  ) ,  X 

L(X  ,F  ) 

and  F 

-5  F 

n  n  n 

n 

n 

(b) 

For  all  n,  the 

distributions  F 

n 

and 

(c) 

X  f  and  X%. 

n  n 

(d) 

Choose  any  bounded 

interval 

[a,b] 

and  i 

event  that  X  (t)  =  X(t)  for  all  te[a,b].  Then  ProbiA 
n  n 

occurs  for  all  sufficiently  large  n}  =  1.  A  similar  property 
k  % 

holds  for  X  and  X  . 
n 

(e)  H(X  )  =>  H(X)  and  H(X*)  =>  H(X*). 
n  n 


Proof  of  Lemma:  Let  Z  and  Z  be  random  variables  with  distribu- 

00  00 

*  * 

tions  F  and  F  respectively.  Since  Zm  ~i  Z^  there  are  sequences 

{Z^}  and  (Z^l  with  the  properties  given  in  (4.11).  Let  F^  and  Fn 

*  * 

denote  the  distributions  of  Z  and  Z  respectively  so  that  F  F 

n  n  r  7  n  n 

for  all  n.  We  now  construct  the  sequence  {x^}.  The  argument  for  (Xnl 
is  the  same.  Construct  independent  copies  of  the  sequence 

dist. 

oo}  =  {Z  :1  <  n  <  °° 

n  —  — 


(Z  :1  <  n  <  <”}  indexed  by  the  letter  i;  {ZJ  :1  <  n  < 
for  -<*  <  i  <  00 .  Let  (T^:-ro  <  i  <  °°}  be  as  in  the  definition  of 
L(X,F).  For  1  £  n  £  00  and  all  t  define 
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xn(t) 


OO 


Y  gz  (t_Ti) 

i=-°°  i,n 


and  take  X  =  X^.  Clearly  X  ^  L(X, F)  and  X^  ^  KX.F^)  so  that  (a) 

is  true.  Properties  (b)  and  (c)  follow  immediately  from  the  properties 

of  {Z  }  given  in  (4.11).  Because  EZ  <  the  number  of  pulses  in 

X^  which  "intersect"  the  interval  [a,b]  is  almost  surely  finite. 

(It  is  easily  shown  that  the  number  of  values  of  i  for  which 

[T.,T.+Z.  1  intersects  [a,b]  has  a  Poisson  distribution  with  mean 

i  l  i,°° 

X(b-a+EZ  ).)  Combining  this  observation  with  the  fact  that  Z.  =*>  Z . 

00  i,n  l ,°° 

for  all  i  shows  that  (d)  is  true.  Finally,  (e)  is  an  immediate 
consequence  of  (d) . 

We  can  now  give  a  more  widely  applicable  result  for  L(A,F). 


(4.13)  Theorem:  Let  X  ^  L(A, F)  and  X  ^  L(X* ,F  )  with  X  =  X 

k 

and  F  -S  F  .  Let  H  be  a  local  functional  with  domain  F* 

(a)  If  H  _>  0,  H  is  L-superadditive  and  H  satisfies  either 
condition  (i)  or  (ii)  below,  then  EH(X)  £  EH(X  ). 

(i)  H  is  increasing. 

(ii)  There  exists  an  increasing  functional  Q  such  that 

H(f )  <  Q(f)  for  all  feF,  EQ(X)  <  «  and  EQ(X*)  <  «>. 

(b)  If  H  is  increasing  and  L-additive,  E | H (X) |  <  '  and 
E  j H(X*) |  <  ”,  then  H(X)  H  H(X*). 

Remark:  Results  (a)  and  (b)  above  can  be  modified  in  the  manner  of 
statements  (c)  and  (d)  in  (4.10). 


I 
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Proof  of  (a):  Let  {X  }  and  {X  }  be  the  sequences  in  (4.12). 

n  n 

Using  (4.10)  we  have  EH(Xn)  £  EH(Xn)  for  all  n  and  by  (4.12e)  we 

have  H(X  )  =«>  H(X)  and  H(X*)  *>H(X*).  To  obtain  EH(X)  <  EH(X*) 
n  n  — 

we  need  only  show  that  EH(X)  =  lim  EH(X  )  and  EH(X*)  =  lim  EH(X*). 

n-K»  n  ^  n-H*>  n 

If  condition  (i)  holds,  then  H(X  )+  and  H(X  )  +  ,  so  that  the  monotone 

n  n 

convergence  theorem  completes  the  proof.  If  condition  (ii)  holds,  then 
H(Xn)  £  Q(Xn)  £  Q(X)  and  H(X*)  £  Q(X*)  £  Q(X*)  for  all  n,  so  the 
result  follows  from  the  dominated  convergence  theorem. 

Proof  of  (b):  First  note  that  H  is  bounded  below.  H  is  local 
and  there  is  positive  probability  that  no  pulses  "intersect"  the  interval 
which  affects  H.  Thus  E  J  H (X)  j  <  °°  implies  |  H(0)  |  <  °°  where  0  denote* 
the  function  which  is  identically  zero.  This  shows  that  H  is  bounded 
below  by  H(0) . 

Let  <|>  be  any  increasing  convex  function.  Clearly  <j>oH  is  increasing 
and  bounded  below  and  by  Lemma  (4.7)  it  is  also  L-superadditive.  Thus  we  may 
apply  the  result  of  part  (a)  to  conclude  E<f>(H(X))  £  E<f>(H(X  ))•  Taking 
<J>(x)  =  x  yields  EH(X)  £  EH(X*). 

Now  take  (j)  to  be  any  convex  function  and  let  u  *  H(0).  Since 
the  graph  of  <J>  has  a  supporting  line  at  the  point  (u,<j>(u)),  we  can 
write  (j>  as  4>(x)  =  4> (u)  +  a(x-u)  +  y(x)  where  a  is  a  constant  and  y  is 
a  function  which  is  convex  and  increases  on  the  interval  [u,00).  From 
above,  we  know  that  Ey(H(X))  £  Ey(H(X  )).  Therefore,  to  prove  that 
E4>(H(X) )  £  E$(H(X*))  it  suffices  to  show  that  EH(X)  =  EH(X*). 

For  all  b  >  0  define  (J)^  by  <(»^(x)  *  -(xAb).  4>b  is  convex  and 

bounded  below.  Therefore  &0H  is  bounded  below  and  L-superadditive 


(using  lemma  (4.7)).  This  allows  us  to  use  (4.10)  to  conclude 

E(J>,  (H(X  ))  <  E$,  (H(X  ))  for  all  n  where  {X  )  and  {X*}  are  as 
d  n  —  d  n  n  n 

in  (4.12).  Equivalently  E(H(X  )a  b)  >  E(H(X*)a  b).  Letting  b  -►  00 

n  —  n 

and  n  -*■  00  gives  EH(X)  EH(X  )  and  completes  the  proof. 

The  results  in  (4.13)  contain  those  of  (1.3)  for  situation  (1.1) 
as  special  cases. 


5. 


Various  Extensions. 


We  can  use  (A. 13)  to  obtain  results  for  many  functionals  H  which 
are  not  local.  To  do  this  we  need  a  sequence  {Hn}  of  local  functionals 
which  satisfy  the  conditions  in  (a)  or  (b)  and  converge  to  H  in  a 
sufficiently  strong  sense.  Two  examples  of  this  are  now  given.  The 
details  are  omitted. 

Our  first  example  generalizes  (2.2).  Let  ^  be  an  arbitrary  function. 
For  1  £  n  £  00  define  Hn  by 


Hn(f)  =  < 


l  if  f(t)  <  iMt) 


0  otherwise  . 


for  all  te(-n,n). 


H  (f)  *  lim  H  (f)  for  all  f.  For  n  <  °°  the  functionals  H  satisfy 
oo  n  11 

rr*»  * 

the  conditions  of  part  (a)  so  that  EH  (X)  <  EH  (X  ).  Letting  n  ■+■  00 

n  —  n 

yields  P(X  £  ip}£  P{x*  £  ^}.  To  avoid  the  triviality  0  £  0  we  must 
demand  that  <Kt)  *►  00  sufficiently  fast  as  t  ± 

The  second  example  resembles  those  of  (2.3).  Let  £  be  any  non¬ 
negative  function  satisfying  £(t)dt  <  00 .  Let  be  any  increasing 

nonnegative  function  which  satisfies  Eip(X(t))  <  00 .  For  1  £  n  £  00 

define  H  by 
n 


Hn(f) 


n 

C(t)T(»(f(t))dt  . 

-n 


H  (f)  *  lim  H  (f)  for  all  f.  For  n  <  ®  the  functionals 
oo  n 

n-H»  * 

the  conditions  of  part  (b)  so  that  Hn(X)  ^  Hn(X  ^  •  Letting 


satisfy 
n  -*•  00  yields 


HJX)  ^  Hm(X  ).  We  briefly  justify  this  last  step.  Clearly  EH^CX)  < 

* 

For  n  <  00  we  have  EH  (X)  *  EH  (X  )  so  that  monotone  convergence 

n  n 

yields  EH^CX)  *  EH^X  ).  Therefore,  as  in  the  proof  of  (b) ,  to  verify 

H^X)  -9  H^ (X* )  it  suffices  to  show  that  E4»(Hoo(X))  <  E<J) (H^CX*) )  for 

all  increasing  convex  functions  4>.  Since  E<J)(H  (X))  <  E4>  (H  (X*))  for 
-  n  —  n 

all  n  <  °°,  this  follows  by  monotone  convergence. 

Various  conditions  concerning  the  pulses  may  be  relaxed  without 
changing  the  character  of  the  results  in  (4.13).  We  have  so  far 
considered  only  pulses  which  satisfy  (4.1);  the  pulses  are  zero  outside 
of  a  bounded  interval.  Using  (4.13)  and  taking  limits,  we  can  deal  with 
pulses  satisfying  the  weaker  condition 


r 

|  gg(t)dt  <  00  for  all  0  . 

i  .00 


This  integral  must  be  finite  to  ensure  that  P{x(t)  <  00  for  all  t}  *  1. 

We  now  sketch  some  of  the  development.  Let  £  be  an  increasing 
function  on  (-°°,0]  satisfying  /^Jg(t)  |dt  <  00  and  5(0)  =  l.  Let 
'p  be  a  decreasing  function  on  [0,°°)  satisfying  / ^  |^(t)|dt  <  00  and 
ip(0)  =  1.  For  1  <  n  <  00  and  9  >  0  let 


g9(t)  H 


£(t)  for 
1  for 
<Kt-8)  for 


-n  1  t  1  0, 

0  <_  t  <_  8 , 

0  £  t  <  n+9  , 


0  otherwise  . 


and  define 


with  and  as  in  the  definition  of  L(X,F).  Clearly  Xn(t)  tX°°(t) 

almost  surely  as  n  00 .  In  any  bounded  interval  this  convergence  will 

be  uniform  (almost  surely).  For  n  <  00 ,  the  processes  Xn  satisfy  the 

requirements  of  (4.13).  If  H  is  sufficiently  regular  so  that 

EH (X°°)  =*  lim  EH(Xn)  or  more  strongly  E4>(H(X°°) )  »  lim  E<MH(Xn))  for 
n-*00  n-*00 

OO 

all  convex  <$,  then  the  results  of  (4.13)  will  extend  to  H(X  ).  For 

example,  if  H  is  an  increasing  local  functional  satisfying 

H(X  )  *  lim  H(Xn)  almost  surely,  then  all  of  the  results  in  (4.13) 

n-wo 

extend  by  just  using  the  monotone  convergence  theorem. 

In  sections  1  and  4  the  amplitude  of  the  pulses  was  arbitrarily 

chosen  to  be  one.  The  results  proved  In  section  4  also  hold  when  the 

amplitude  and  shape  of  the  pulses  are  allowed  to  vary  randomly.  Let 

{gQ  a:  0  >  d(a),aeA}  be  a  parametric  family  of  pulses  with  the  parameter 

a  taking  values  in  a  set  A.  Assume  that  for  any  fixed  value  oCqEA, 

the  family  (gft  :9  >  d(an)}  satisfies  (4.1)  and  (4.2). 

9, a  -  0 

w  /  j  \ 

For  example,  suppose  {gg  :9  _>  d^}  for  1  £  i  <_  k  are  k  different 
parametric  families  each  satisfying  (4.1)  and  (4.2).  Take  A  *  {l,2,...,k) 
and  define  89  a  =  89  ^  and  d(ot)  =  da  for  a  e  A.  For  another  example, 
let  ^80>®  satisfy  (4.1)  and  (4.2)  and  define  89  a  “  “89 » 

A  =  {ot:a>0)  and  d(a)  =  d.  In  this  example,  the  parameter  a  determines 
the  amplitude  of  the  pulse  and  9  determines  the  duration. 

With  periodic  pulses  {gg  a:d(a)  <_  9  <  P,aeA)  defined  by 


we  may  define  a  periodic  process 


X(t)  “  l  «Z  W  (t*Ti) 

i-1  i’wi  1 

where  T^^, . . .  are  i.i.d.  uniform  on  [0,P)  and  (Z^,W^), 

(22^2)  , . . . ,  (Zn,Wn)  are  indpendent  random  vectors.  The  probability 

measure  of  (Z^,W^)  is  denoted  y^  and  we  assume  that 

Prob{d(W^)  <_  Zi  <  P,Wi  e  A}  *  1  for  all  i.  The  notation 

X  *v«  C  (y.  ,y  ,...,y  )  is  used  to  refer  to  this  process.  The  analog 
p  x  2  •* 

of  (A. 4)  for  this  process  is  now  given. 

(5.1)  Theorem:  Let  X  ^  C  (y  ,y  ,. . . ,y  )  and  X*^  C  (y*,y*  ,.,y*) 

p  l  z  n  plZ  n 

*  *  * 

Assume  for  all  i  that  (Z^,W^)  ^  y^  and  (Z^W^)  ^  y^  satisfy 

dlst.  A  1  £  if 

W±  -  W±  and  E(4>(Z1)|Wi»a)  <  E(<KZi)|Wi-a)  for  all  ct  e  A  and 

all  convex  functions  <{>.  If  H  ^  0  and  H  is  L-superadditive,  then 

EH(X)  <  EH (X* ) . 

The  proof  is  basically  the  same  as  that  of  (4.4).  Assume  that 
* 

y.^  “  y^  for  1  <  i  <  n-1.  Without  loss  of  generality,  we  can  then 
*  *  * 

take  T^  *  T^,  *  W^  and  Z^  *  Z^  for  1  <  i  <  n-1.  Since 

dist  *  * 

W  »  W  we  can  also  assume  W  *  W  .  Now  lemma  (4.5)  shows  that 

n  n  n  n 

the  theorem  holds  conditionally  given  the  values  of  T^,T2*...,Tn 
^1*^2*  •  •  •  2*  •  •  • 9 

We  could  parallel  the  development  of  section  4  and  prove  a  more 
general  version  of  (4.13)  based  on  (5.1).  Instead,  we  shall  just  state 
a  special  case.  Let  T^,  Z^  and  {gg’.Q  1  d}  be  as  in  the  definition  of 
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L(A,F).  Let  <  j  <  “}  be  nonnegative  random  variables  which  are 

i.i.d.  according  to  a  distribution  G.  Define  the  process  X^L(A,F,G) 
by 


X(t)  -  l  Y  g  (t-T  )  . 
i— °°  1  1  1 

Thus  X  is  a  superposition  of  pulses  having  both  random  amplitudes  and 
durations. 

*  *  *  *  * 
(5.2)  Theorem:  Let  X ^ 1(A,F,G)  and  X  ^  L( A  ,F  ,G  )  with  A  -  A  , 

•ft 

G  *  G  and  F*^  F  .  If  H  is  local,  nonnegative  and  L-superadditive, 
then  EH(X)  <  EH(X*). 


The  proof  is  omitted. 


6.  Weaker  Results  for  More  General  Pulse  Shapes. 

Weaker  conclusions  may  be  obtained  under  weaker  assumptions  on  the 
form  and  duration  of  the  pulses.  Let  {gg : 9  d}  be  a  family  of  pulses 

which  satisfies  (4.1)  and  the  condition  given  below. 

gQ+e+6  >  g6+e  v  (S£g0+6)  and 
(6*1)  S£g0  >  g0+e  a  (Seg0+6)  for  all 

0  >  d,  e  £  0,  6  >  0  . 

This  condition  is  the  same  as  (4.2)  except  that  has  been  replaced  by 

Two  examples  of  parametric  families  of  pulses  which  satisfy  (6.1) 
with  d-0  will  now  be  given.  Let  ^  be  any  increasing  function  on 
[O,00)  with  iMO)  £  0.  For  our  first  example,  for  all  0  £  0  define 

ip(0-t)  for  0  £  t  5  0, 

g0(t)  =  i 

0  otherwise  . 

The  second  example  is  a  family  of  symmetric  pulses  defined  for  0  £  0 
by 

ij;(t)  for  0  £  t  £  0/2 
gg(t)  -  <^(0-t)  for  0/2  £  t  £  0, 

0  otherwise  . 


The  verification  of  (6.1)  is  easy  for  both  examples. 


We  also  use  a  weaker  version  of  the  variability  ordering  defined 
as  follows.  Let  Y  and  Z  have  distributions  F  and  G  respectively. 


Assume  EY  >  -00  and  EZ  >  -°°.  If  E<Jt(Y)  £  E$(Z)  for  all  functions 
<j>  :  R  ■»  R  which  are  increasing  and  convex,  then  we  say  that  t  G 
or  equivalently  Y-3tZ.  This  version  of  the  variability  ordering  is 
frequently  used.  See  the  references  given  in  section  1. 

Using  the  family  {g^:©  1  d)  satisfying  (4.1)  and  (6.1),  we  define 
the  process  X  ^  L(A,F)  as  in  section  4.  With  only  minor  changes  in 
the  proof  we  can  obtain  the  following  modification  of  theorem  4.10. 

(6.2)  Theorem:  Let  X  'v-  i(A,F)  and  X  'v  L(A  ,F  )  with  A  =*  A 
and  F  ^  t  F*.  Suppose  that  H  is  a  local  functional  defined  on  a 

it 

sufficiently  large  class  of  functions.  Assume  that  F  and  F  have 
bounded  support,  F(B)  *  F*(B)  *  1  for  some  B  <  °°.  If  H  is  nonnegative, 
increasing  and  L- super additive,  then  H(X)  ^  +  H(X  )  which  further  implies 
that  EH(X)  £  EH(X*). 

Proof:  Let  {g^:  d  £  0 <  P}  be  periodic  pulses  with  period  P 
defined  as  in  section  4.  Property  (4.3)  holds  as  stated  because  replacing 

(4.2)  by  the  weaker  condition  (6.1)  is  compensated  for  by  imposing  the 
additional  condition  that  H  be  increasing.  The  proof  of  (4.4)  proceeds 
as  before  except  that  the  crucial  lemma  4.5  must  be  slightly  modified  as 
follows. 


(6.3)  Lemma:  Let  H  satisfy  the  conditions  in  (6.2).  For  d  £  0  <  P 
and  any  function  f  define 


$(9) 


io 


H(f+Stg£)dt  . 


Let  and  be  random  variables  taking  values  in  [d,P).  If 

Y1-§+Y2,  then  E$(YX)  <  E$(Y2) . 

To  prove  this  lemma  just  show  that  $  is  increasing  and  convex  on 
[d,P)  by  following  the  pattern  of  (4.5). 

* 

We  have  now  shown  that  when  X  and  X  are  periodic  processes 
like  those  in  (4.4),  EH(X)  <_  EH(X*)  for  all  H  satisfying  the  conditions 
of  (6.2).  By  the  next  lemma,  this  implies  H(X)  ^tH(X*). 

(6.4)  Lemma:  If  <f>  is  increasing  and  convex  and  the  functional  H 
is  increasing  and  L-superadditive,  then  the  composition  4>  o  H  is 
increasing  and  L-superadditive. 

This  property  is  given  by  Topkis  in  [13].  The  proof  is  similar 
to  lemma  4.7. 

Transforming  the  result  for  the  periodic  processes  into  theorem  6.2 
is  accomplished  by  the  same  arguments  which  took  us  from  (4.4)  to  (4.9) 
and  then  to  (4.10). 
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1 .  Notes  on  the  Variability  Ordering. 

The  next  three  lemmas  are  needed  to  complete  the  proof  of  lemma  4.5. 
Let  4>:  J  -*•  [O,00]  where  J  is  any  convex  subset  of  the  real  numbers 
We  assume  that  4>(w)  +  $(z)  £  $(x)  +  $(y)  whenever  w,x,y,zeJ, 
w<x<y<z  and  w+z  =  x+y.  Let  D  denote  the  effective  domain  of  <J>, 

D  =  (x:<J>(x)  <  °°}  . 

(7.1)  Lemma:  The  set  D  is  convex  and  $  is  a  convex  function  on 
D. 

Proof:  If  D  is  empty  or  consists  of  a  single  point,  the  lemma  is 
trivial.  Suppose  $(a)  <  <»,  $(b)  <  “  and  a<x<b.  Then 
$(a)  +  $(b)  £  $(x)  +  <5>(a+b-x)  £  <I>(x)  since  $  £  0.  Thus  $  is  bounded 
above  by  <J>(a)  +  $(b)  on  the  interval  [a,b].  The  function  $  is 
midconvex;  $(w)  +  $(z)  £  2<t  ((w+z)/2)  for  all  w,z£  J.  A  result  due  to 
Jensen  (see  section  72  of  Roberts  and  Varberg  [4])  shows  that  a  mid- 
convex  function  bounded  above  on  [a,b]  is  convex  on  [a,b].  This 
completes  the  proof  since  a  and  b  are  arbitrary  members  of  D. 

(7.2)  Lemma:  Suppose  that  X -S  Y.  If  Prob{Y  £  c}  *  1,  then 
Prob{X  £  cl  *  1  and  Prob{X-c}  £  Prob(Y-c}.  If  Prob(Y  £  d}  ~  1, 
then  Prob(X  £  d}  *  1  and  Prob(X  =  d}  £  Prob{Y*d}. 

Proof:  (z)+  will  denote  the  positive  part  of  z,  (z)+ = max(z ,0) . 

Define  f(x)  *  (x-d)+.  f  is  convex  and  finite  on  the  entire  real  line 

so  that  Ef(X)  £  Ef(Y).  Prob{Y  £  d}  *  1  implies  Ef(Y)  *  0  so  that 

Ef (X)  =  0  and  Prob{X  <  d}  ■  1.  Now  define  f  (x)  *  n(x-d+l/n),.  For 

—  n  t 

x  <  d  we  have  If  (x) I  <  1  for  all  n  and 
—  1  n  ‘  — 
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|1  if  X  -  d, 

lim  f  (x)  =  \ 

n  | 

n  -*■  oo 

l0  if  x  <  d. 

f  is  convex  and  finite  so  that  Ef  (X)  <  Ef  (Y)  for  all  n.  Assuming 
n  n  —  n 

Prob{Y  £  d}  =  1  and  using  the  bounded  convergence  theorem  yields 
Prob{X  =  d}  £Prob{Y  =  d}.  The  proof  of  the  other  statement  is  similar. 

A  convex  function  ip  is  called  proper  if  \p(x)  <  »  for  at  least 
one  x  and  iJj(x)  >  -°°  for  all  x. 

(7.3)  Lemma:  Let  tp  by  any  proper  convex  function.  If  X  <  Y, 
then  Eip(X)  <  Ei(;(Y). 

Proof:  We  assume  first  that  ip  is  closed.  This  means  that 

(x:\p(x)  £  a)  is  a  closed  set  for  all  a.  Define  ip  (y)  *  sup{xy-i|;(x)} 

x 

**  * 

and  tp  (x)  «  supixy-4*  (y)J.  ip  is  a  proper  closed  convex  function  and 
**  y 

ip  *  ip  (see  section  12  of  Rockafellar  [5]).  Choose  yQ  such  that 

tp  (yQ)  <  00 .  Define  ^n(x)  *  sup{xy-ijj  (y):yg-n  <  y  <  yg+n).  is 

easily  seen  that  tpn  is  convex  for  all  n.  The  following  argument 

shows  that  <J>n(x)  <  00  f°r  all  n  and  x.  Choose  Xq  such  that 

* 

»Mxq)  <  00 .  Clearly  tp  (y)  £  x^y  -  ip(x^)  for  all  y.  Thus 

4»„(x)  £  sup{y(x-xQ)  +iKxq)  :yQ  -  n  <  y  <  yQ  +  n}  £  p|x-xQ|  +  ^(xQ)  where 

p  =  max(  jy^-nl ,  |yg+nj ) .  Therefore  E^n(X)  £  E^(Y)  for  all  n.  Since 
** 

*  tp  we  have  ip  (x)  t^(x)  as  n  -*■  00  for  all  x.  Also  note  that 
n 

* 

tp  (x)  >  xy n-ip  (yn)  for  all  x  and  n.  Thus  ip  (X)  and  tp  (Y)  are 
n  —  u  u  n  n 


bounded  below  by  random  variables  having  finite  means  and  we  may  apply 
the  monotone  convergence  theorem  to  conclude  Etp(X)  <  Ei^(Y). 


Now  let  ip  be  any  proper  convex  function.  Let  B  be  the  effective 


domain  of  ip,  B  =  {x:i^(x)  <“}.  There  exists  a  proper  closed  convex 
function  f  which  agrees  with  ip  except  perhaps  on  the  boundary  of 
B  (denoted  3B) .  More  precisely,  i|>(x)  =  f(x)  for  x t  3B  and 
ip (x)  >  f (x)  for  x £  3B  (see  section  7  of  Rockafellar  [5]).  Our 
conclusion  now  follows  from  lemma  7.2  and  the  previous  paragraph. 

For  example,  suppose  B  =  [c,d].  If  Prob(c  <_  Y  £  d}  <  1,  then 
Eip(Y)  =  00  and  therefore  Exp (X)  £  E^(Y)  as  desired.  Now  assume 
Prob{c  <  Y  <  d}  ■  1.  Lemma  7.2  implies  Prob{c  £  X  £  d}  =  1, 

Prob{x  =  c)  £  Prob(Y=c}  and  Prob{X  =  d}  £Prob(Y-d}.  Let  a  *  i^(c)-f(c) 
and  3  =  >p(d)-f(d).  We  can  write 

Eip(X)  =  Ef  (X)  +  a  ProblX=c}  +  3Prob(X=d} 


and  similarly  for  Eip(Y).  Since  a  £  0,  3  £  0  and  Ef(X)  £  Ef(Y), 
we  immediately  conclude  ElKX)  £  Ei^(Y). 

Extending  the  definition  of  $  by  taking  ^(x)  =  00  for  x  t  J 
makes  $  into  a  proper  convex  function.  Thus  X  Y  implies 
E$(X)  £  E$(Y)  and  the  proof  of  (4.5)  is  complete. 

We  now  give  a  proof  of  lemma  4.11.  The  following  facts  will  be 
needed . 


(7.4)  Let  V  and  W  be  nonnegative  random  variables  with  EV  <  °° 
and  EW  <  oo  having  distributions  F  and  G  respectively. 


(a)  EV  =  EW  if  and  only  if 


(G (x)  -  F (x) )dx  =  0 


(b)  If  EV  *  EW,  then  V  <  W  if  and  only  if 
for  all  t. 


(G(x)-F(x))dx  >  0 


3 


Fact  (a)  is  elementary.  Fact  (b)  is  a  minor  variant  of  results  in 

sections  1.3  and  1.4  of  Stoyan  [12]  or  section  8.5  of  Ross  [7]. 

Proof  of  (4.11):  Suppose  V  W  with  V  and  W  as  in  (7.4). 

Define  a  =  sup{x:F(x)  <  1}  and  8  =  sup{x:G(x)  <  l}.  F  G  implies 

a  £  8  by  lemma  7.2.  Note  that  E(VAt)  is  continuous  and  strictly 

increasing  in  t  for  t  <  a  and  E(W  At)  is  continuous  and  strictly 

increasing  in  t  for  t  <  8.  Since  4> (x)  =  xAt  is  a  concave 

function,  E(V  nt)  >  E(Wa  t)  for  all  t.  If  8  <  00 ,  then  a  <  00 

and  the  lemma  is  trivial,  just  take  V  =  V  and  W  =  W  for  all  n. 

n  n 

So  assume  8  =  °°.  a  may  be  finite  or  infinite.  The  proof  proceeds 
in  two  cases. 

First  case,  assume  Prob(V=a} = 0.  Choose  a  nonnegative  sequence 

fcx  }  satisfying  a  +  a  and  a  <  a  for  all  n.  Define  V  =  V  a.  a 

n  n  n  n  n 

for  all  n.  Clearly  V  t  and  V  =►  V.  Since  E(W  aoi  )  <  E(V  Act  ) 

7  n  n  n  —  n 

<  EV  =  EW,  there  exists  a  unique  8  such  that  8  >  a  and 

n  n  —  n 

E(Wa  S  )  =  EV  .  Define  W  =  W  ^ 8  for  all  n.  Since  EV  t  EV,  we 
n  n  n  n  n 

have  6  +  00  and  thus  W  t  and  W  =*>  W.  Let  F  and  G  be  the 

n  n  n  n  n 

distributions  of  Vr  and  W^  respectively.  Define 

(t)  =  /*!  (G  (x)-F  (x))dx.  ip  (t)  >  0  for  t  <  a  because 
n  unn  n  —  —  n 

Gn(x)  -  Fn(x)  =  G(x)-F(x)  for  x  <  a^.  ^n(t)  is  decreasing  when 

a  <  t  <  8  because  F  (x)  =  1  for  x  >  a  .  Finally,  ip  (t)  =  0  for 
n  —  n  n  —  n  '  n 

t  >  8  because  EV  =  EW  .  Thus  <p  (t)  >  0  for  all  t  so  that 
—  n  n  n  n  — 

F  -i  G  by  (7.4b) . 
n  n 

Second  case,  assume  a  <  00  and  Prob(v=a}  >  0.  E(Waci)  <  EV  so 
there  exist  c  and  d  such  that  c  <  a  <  d  and  E(Va  c)  =  E(WAd). 
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As  in  the  first  case  we  have  (V  A  c)  -*>  (W  Ad).  Let  U  be  a  random 
variable  which  is  uniformly  distributed  on  the  interval  (0,1)  and 
independent  of  V  and  W.  Define 


V  \  c  if  U  <  -  , 
n 


V  if  U  >  -  . 

—  n 


Clearly  V  t  and  V  =*>  V.  Since  E(WAd)  <  EV  <  EV  =  EW,  there 
n  n  —  n 

exists  6  >  d  such  that  E(W  A  3  )  *  EV  .  Define  W  =  WA  3  . 

n  —  n  n  n  n 

EV  t  EV  implies  3  +  00  so  that  W  +  and  W  =«>  W.  Now  we  use 
n  n  n  n 

V  W,  (Vac)  ^  (W  a  d)  and  (7.4)  to  show  this  construction  gives 

V  >5  W  as  desired.  Let  V  ,  W  ,  VAc,  WAd  have  distributions 

n  n  n  n 

denoted  by  Fn>  Gn>  F^,  G(d)  respectively.  Note  that 

^  F(c)  +  (1  ~  “)F.  or<^er^n8  is  preserved  by  mixtures  so 

that  F  —  G +  (1  -  — )G.  Again  define  ip  (t)  *  (G  (x)-F  (x))dx. 
n  n  (.a;  n  n  u  n  n 

Since  ^  G^(x)  +  (l-^-)G(x)  *  G(x)  ■  G^(x)  for  x  <  d,  ^R(t)  2l  0 

for  t  _<  d.  tf^n(t)  is  decreasing  when  d  £  t  <  3n  because  d  >  a 

and  F  (x)  =  1  for  x  >  a.  ip  (t)  =  0  for  t  >  3  because  EV  *  EW  . 

n  —  n  —  n  n  n 

Thus  ^n(t)  _>  0  for  all  t  and  the  proof  is  complete. 
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An  Attempt  to  Use  Shot  Noise  in  Models  for  Neuron  Firin 


This  report  deals  with  a  shot  noise  process  X(t)  which  is  formed 
by  the  superposition  of  random  pulses  (or  shot  effects)  which  arrive  at 
random  times  according  to  a  Poisson  process.  One  area  in  which  shot 
noise  processes  arise  is  in  the  construction  of  models  in  the  neural 
sciences.  This  is  because  the  cell  membrane  potential  in  neurons  is 
formed  by  the  superposition  of  distinct  contributions  (pulses)  arising 
from  the  many  hundreds  (or  thousands)  of  synapses  which  impinge  on  each 
neuron.  A  contribution  from  an  excitatory  (inhibitory)  synapse  is 
represented  by  a  pulse  having  a  positive  (negative)  amplitude.  In  the 
simplest  models  the  neuron  fires  (produces  an  action  potential)  whenever 
the  membrane  potential  at  the  axon  hillock  exceeds  a  certain  threshold 
value  (except  for  complications  introduced  by  the  presence  of  absolute 
and  relative  refractory  periods). 

For  a  brief  description  of  the  functioning  of  neurons  and  a  catalog 
of  mathematical  models  which  have  been  developed  to  explain  the  spike 
trains  of  single  neurons,  see  Sampath  and  Srinivasan  [B] .  Many  of  the 
models  contained  therein  share  some  of  the  features  of  shot  noise  (for 
example,  see  model  7.6  on  page  100).  We  note  also  that  Bevan,  Kullberg 
and  Rice  [A]  have  used  a  shot  noise  process  with  rectangular  pulses  to 
model  the  acetylcholine  induced  membrane  noise  which  occurs  at  the  neuro 
muscular  junction. 

This  report  was  initially  motivated  by  a  desire  to  prove  results 
concerning  the  spike  trains  of  single  neurons.  In  particular,  let  U(X) 


denote  the  number  of  upcrossings  of  the  threshold  value  made  by  the  shot 


2 


A 


noise  process  X  during  the  time  period  (0,T).  In  a  simple  model  of 
neuron  firing,  U(X)  will  be  the  random  number  of  spikes  produced 
during  a  period  of  length  T.  In  more  complicated  models,  the  number 
of  spikes  can  be  written  as  a  more  complicated  functional  of  the  process 
X.  However,  I  was  unable  to  obtain  strong  results  for  these  functionals. 
The  functional  U  does  not  satisfy  the  conditions  for  applying  Theorem 
(1.3).  Attempts  were  made  to  weaken  these  conditions.  The  conditions 
used  in  statements  (c)  and  (d)  of  Theorem  (4.10)  are  weaker  than  those 

in  (1.3).  The  functional  U  satisfies  the  conditions  in  (c)  but  the 

*  * 
conclusion  EU (X)  £  EU (X  )  is  quite  weak  since  in  fact  EU(X)  =  EU(X  ). 

The  conclusion  of  (d)  is  stronger,  but  U  fails  to  satisfy  all  the 

conditions  in  (d) . 


i 
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